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Digital Image Processor, 1976 


THERE ARE AT LEAST TWO OF THEM inone body, Jeffy and Jeff. Jeffy of course is playful, 
funny and fast. Jeffis a reincarnated police interrogator. They both live with a third person, Diane ina 
little wooden house erected right over a long forgotten geological fault in Oakland. 

Without him, being our student in Buffalo, we could never have gotten our education. Luckily, the 
only way Jeffy, living in the left hemisphere could inform Jeff living in the other, was through the 
acoustic interface of speech. To close the circuit, an interlocutor had to be found, Steina or me. That's 
how we learned. 

Jeffy vastly expanded the McArthur concept. He put several modules on the bus, elevating it from 


mathematics to a visual experience. But his true masterpiece, “The Image Articulator,” was yet to come. 


—wW.V. 


JEFFREY SCHIER was educated at the State 
University of N.Y. in Buffalo, where he worked asa 
design engineer for the Vasulkas. During that time 
he facilitated the software/hardware interface of 
several unique video processing machines to a DEC 
LSI-11 microcomputer: George Brown Multi-level 
Keyer, Seigel Colorizer, Rutt/Etra Scan processor. 
Schier was the co-designer of the MacArthur/Schier 
real-time Image Processor. Later he designed and 
implemented the Image Articulator: a bit-slice frame 
buffer with real time image manipulation abilities. 
Subsequently, he worked as project leader for color 
graphics CAD Workstation applied to PC board 
design; he was lead designer of the GMR2800 
Computer Graphics Image Processing system at 
Grinell Systems, and he has worked as a senior 
research engineer at Cubicomp Corporation, and at 
Aurora Systems. From 1987-89 he worked for Pin- 
nacle Systems as project manager for development 
ofPriZm digital video effects system (DVE). The DVE 
performs real-time rotation, perspective transfor- 
mations, and curved/warping of the image; with the 
aid of a color menu interface. Presently, he works at 
Chips and Technologies, Inc. as Staff Design 
Engineer. 
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DIGITAL IMAGE PROCESSOR 

The Schier/McArthur Digital Image Processor 
was constructed in 1976-1977 at Steina and Woody 
Vasulka’s loft in Buffalo, N.Y. It began as a mathe- 
matical exploration by Don McArthur of the digital 
raster and was built from digital modules locked to 
video time by a 16 bit micro-computer: a DEC LSI- 
11. It was built in stages starting with the sync 
generator and computer interface. A digital Selector, 
Arithmetic-Logic Unit, lookup/pattern RAM and a 
rectangular Window Generator were added later. 
The video outputs came from three 4 bit digital to 
analog converters, and was converted to color 
composite video by an external NTSC color encoder. 
The video tape recorder was on continuous standby, 
allowing documentation of the design process by 
Steina through “pressing the record button.” 

The modules were “wire-wrapped” and connected 
to the computer control and timing bus at the rear 
ofthe modules. The digital video paths were patched 
together with multi-conductorribbon cables plugged 
into the front of each module. External audio could 
be patched in or out from the front panel, converting 
the video timing signals to sound. Emphasis was 
placed on internal square waveforms to form the 
first pictures made from the horizontal and vertical 
bar patterns that subdivide the raster. A borrowed 
time base corrector was “hot-wired” to pull out 6 bits 
of live digital video from its A to D (analog to digital) 
converter and color-mapped through the lookup/ 
pattern RAM. A random “power-up” pattern was 
saved from the RAM and formed a favorite color test 
pallette for adding colors to the image. The real-time 





remapping of intensity to color formed a color 
precision (64 levels) unseen in analog colorizers. 
Dual four bit Analog to Digital converters were later 
constructed to digitally combine two image sources. 
Operations were performed at 4 bit resohation per 
red, green and blue channel, but were funneled 
down to 6 bits when running through the lookup/ 
pattern RAM. 

The digital combination of binary images formed 
unique geometric color patterns. These were unex- 
pected and did not correspond to other analog 
processes. This became evident when the Arithme- 
tic/Logic Units (ALU’s) were installed. The ALU’s 
performed arithmetic functions (addition, subtrac- 
tion), and logical functions (And, Or, Exor, Nega- 
tion) and wacky mixed arithmetic and logical opera- 
tions that were “thrown in” by the semiconductor 
vendor, such as (A OR B plus 1). The bitwise 
combination of image combined with overflow/ 
wrap-around conditions generated unusual pat- 
terns of color and box-like textures without equiva- 
lence in analog video. The binary operations made 
sense but the images were a digital surprise. “Offi- 
cial” test images were needed to test out the ALU 
process. This consisted of a white styrofoam sphere 
or cone and Woody’s hand waved in front of the 
camera. These test images contain 16 discernible 
levels of grey, useful to disclose the arithmetic/ 
logical binary combinations and overflow condi- 
tions. The explorations of real-time digital video at 
the Vasulkas predated later image processing and 
digital video effects units. The exploration of binary 
operations between images has largely been ignored 
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Left: Jeff Schier in the Vasulkas loft, 1977, Buffalo, 
New York. Photo: Woody Vasulka, 
Below; Digital Image Processor. 





in image processing and computer graphics in it’s 
quest for photo-realistic imagery. 

‘Time-locked software marching to the video frame 
rate formed the real-time control structure needed 
to operate the digital image processor. Various test 
and control table programs were written in Fortran 
and PDP-11 Assembly language to operate the 
processing modules. Walter Wright programmed 
“BARBAR,” an assembly language control program 
with independent timing control stacks. BarBar's 
timing stacks control processing module functions, 
time delays, and the looping of the control sequence. 
The inclusion of random functions exercise the 
hardware, contributing to long sequences of digital 
permutations. 

‘The hardware consists of a rack of digital proc- 
essing modules, a gen-locked sync generator, a 
vertical interval control bus, and a microcomputer 
to orchestrate the field by field control. The digital 
video paths for the processing modules are “patched” 
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through their front panels. Signal Path: Input is 
received through camera sources, video tape sources, 
or the internal pattern source (H and V timed bar 
patterns). The camera and VIR sources route 
through the A/D converters first. There they are 
front panel patched to the processing modules and 
converted back through the D/A converters into 
RGB video and then to a RGB to NTSC encoder for 
composite color output. 

1) Microcomputer: a 16 bit DEC LSI-11 micro- 
processor coordinates control words for the proc- 
essing modules and handles user interface func- 
tions. 

2) A Vertical Interval Control Buffer and Transfer 
Bus: control information is loaded into this control 
buffer by the microprocessor during the current 
active field. The data is shipped down to processing 
modules during the next vertical blanking interval. 

3) Processing Modules: 

A) Analog to Digital Converters (A/D) consisting 
of two 4 bit converters. 

B) Selectors (3 groups) which choose between 8 
horizontal, and 8 vertical frame-locked patterns, 
and an external digital source. The selectors allow 
bit-wise selection of horizontal/vertical timing com- 
ponents and external video inputs. 


tates VERTICAL INTERVAL GEN-LOCK SYNC 
COMPUTER BUFFER GENERATOR 


CONTROL and TIMING - X/Y TIMING BUS 
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C) Arithmetic Logic Units (ALU’s) which combine 
two digital input streams intoa single output through 
combinations of arithmetic and Boolean logic func- 
tions (Output = function (A_in, B_in). The Boolean 
functions of ‘AND,’ ‘OR,’ ‘EXOR,’ ‘EXNOR,’ Ones 
Complement are present. The arithmetic ‘A PLUS B 
PLUS CARRY,’ ‘A MINUS B PLUS CARRY, 2’s 
Complement are also available. Certain combina- 
tions of arithmetic with logical operations are pos- 
sible, with a ‘Constant’ available on the “B’ input, 
useful for bit-masking. 

D) Lookup consisting of an RGB lookup table 
with common digital address input is present to 
perform intensity/pseudo-color transformations. 
The memory could be loaded then scanned out asa 
small raster. 

E) Window generator: three Window generators 
form an adjustable frame for gating/routing the 
digital sources. The frames are independently pro- 
grammable ona pixel/line basis. Wipe patterns and 
title boundaries are formed by the same principle. 

F) Digital to Analog Converters: one apiece for 
Red, Green and Blue components at 4 bits per gun. 

4) A Gen-Lockable Syne Generator which forms 
sync timing, and subdivides the active screen into 
512 H by 486 V coordinates. Both video syne and H 
and V timing information is available on the 
control bus to be picked-off the modules’ 
program. A Phase Locked Loop locks the 
clock timing to an external sync source. 

5) RGB to NTSC Color Encoder comprises 
the funnel for output and converts the RGB 
signals from the D/A converters to an NTSC 
color composite video signal for display and 
recording onto video tape. —J.S. 
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